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Abstract 

Recently, it has been shown that probabilis- 
tic entailment under coherence is weaker than 
model-theoretic probabilistic entailment. More- 
over, probabilistic entailment under coherence 
is a generalization of default entailment in Sys- 
tem P. In this paper, we continue this line of 
research by presenting probabilistic generaliza- 
tions of more sophisticated notions of classi- 
cal default entailment that lie between model- 
theoretic probabilistic entailment and probabilis- 
tic entailment under coherence. That is, the 
new formalisms properly generalize their coun- 
terparts in classical default reasoning, they are 
weaker than model-theoretic probabilistic entail- 
ment, and they are stronger than probabilistic en- 
tailment under coherence. The new formalisms 
are useful especially for handling probabilistic 
inconsistencies related to conditioning on zero 
events. They can also be applied for probabilistic 
belief revision. More generally, in the same spirit 
as a similar previous paper, this paper sheds light 
on exciting new formalisms for probabilistic rea- 
soning beyond the well-known standard ones. 



1 Introduction 

In the recent decades, probabilistic reasoning has become 
an important research topic in artificial intelligence. In par- 
ticular, extensive research has been carried out on proba- 
bilistic reasoning with interval restrictions for conditional 
probabilities, also called conditional constraints [p^. 

One important approach for handling conditional con- 
straints is model-theoretic probabilistic logic, which comes 
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especially from philosophy and logic, and whose roots go 
back to Boole's book of 1854 "The Laws of Thought" 
[pi]]. There is a wide spectrum of formal languages that 
have been explored in model-theoretic probabilistic logic, 
ranging from constraints for unconditional and conditional 
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events [|16[^^^|19|,^|33|,|4^,|39|^^^to rich 
languages that specify linear inequalities over events [p2|]. 
The main problems related to model-theoretic probabilis- 
tic logic are checking satisfiability, deciding logical conse- 
quence, and computing tight logically entailed intervals. 

Another important approach to probabilistic reasoning with 
conditional constraints, which has been extensively ex- 
plored in the area of statistics, is based on the coherence 
principle of de Finetti and suitable generalizations of it 
[|, H [ij, |l5], ll, H, H, 1^, or on similar princi- 
ples that have been adopted for lower and upper probabil- 
ities [ p^ p4| ]. Two important aspects of dealing with un- 
certainty in this framework are (i) checking the consistency 
of a probabilistic assessment, and (ii) the propagation of a 
given assessment to further uncertain quantities. 

Recently, the relationship between model-theoretic proba- 
bilistic logic and probabilistic logic under coherence has 
been thoroughly explored in [|lO|]. In particular, it turned 
out that probabilistic entailment under coherence is weaker 
than model-theoretic probabilistic entailment. Moreover, 
it has been shown in [|o|] that probabilistic entailment un- 
der coherence is a generalization of classical default en- 
tailment in System P, while model-theoretic probabilistic 
entailment is well-known to be a generalization of model- 
theoretic entailment in classical propositional logics. 

In this paper, we continue this line of research by present- 
ing probabilistic generalizations of more sophisticated for- 
malisms for default reasoning from conditional knowledge 
bases, which lie between probabilistic entailment under co- 
herence and model-theoretic probabilistic entailment. That 
is, the new notions of entailment generalize their classical 
counterparts, they are stronger than entailment under co- 
herence, and weaker than model-theoretic entailment. 



The literature contains several different proposals for de- 
fault reasoning from conditional knowledge bases and ex- 
tensive work on its desired properties. The core of these 
properties are the rationality postulates of System P pro- 
posed by Kraus et al. [p4||. It turned out that these ratio- 
nality postulates constitute a sound and complete axiom 
system for several classical model-theoretic entailment re- 
lations under uncertainty measures on worlds. In detail, 
they characterize classical model-theoretic entailment un- 
der preferential structures [|TJ infinitesimal probabil- 
ities [|ll FtI, possibility measures and world rank- 
ings [p4 [3l|]. They also characterize an entailment relation 
based on conditional objects [p^. A survey of all these 
relationships is given in 

Mainly to solve problems with irrelevant information, the 
notion of rational closure as a more adventurous notion 
of entailment was introduced by Lehmann ^ |. It is 
equivalent to entailment in System Z by Pearl [[4-8|], to the 
least specific possibility entailment by Benferhat et al. [^j], 
and to a conditional (modal) logic-based entailment by 
Lamarre p5[ ] . Finally, mainly to solve problems with prop- 
erty inheritance from classes to exceptional subclasses, the 
maximum entropy approach to default entailment was pro- 
posed by Goldszmidt et al. [ pO|]; lexicographic entailment 
was introduced by Lehmann [|37| and Benferhat et al. 
conditional entailment was proposed by Geffner [ p5| , p6|; 
and an infinitesimal belief function approach was suggested 
by Benferhat et al. [0]. 

In this paper, we define probabilistic generaUzations of en- 
tailment in Pearl's System Z and Lehmann's lexicographic 
entailment that lie between entailment in model-theoretic 
probabilistic logic and entailment in probabilistic logic un- 
der coherence. Roughly speaking, the main difference be- 
tween model-theoretic probabilistic entailment and proba- 
bilistic entailment under coherence is that the former real- 
izes an inheritance of logical knowledge, while the latter 
does not. Intuitively, the new formalisms now add a strat- 
egy for resolving inconsistencies to model-theoretic prob- 
abilistic logic, and a restricted form of inheritance of logi- 
cal knowledge to probabilistic logic under coherence. This 
is why the new notions of entailment are weaker than en- 
tailment in model-theoretic probabilistic logic and stronger 
than entailment in probabilistic logic under coherence. 

Hence, the new formalisms are refinements of both model- 
theoretic probabilistic entailment and probabilistic entail- 
ment under coherence. They can be used in place of model- 
theoretic probabilistic entailment, when we want to resolve 
probabilistic inconsistencies related to conditioning on zero 
events. Here, the new formalisms are especially well-suited 
as they coincide with model-theoretic probabilistic entail- 
ment as long as we condition on non-zero events. Further- 
more, the new formalisms can be used in place of proba- 



bilistic entailment under coherence, when we also want to 
have an inheritance of logical knowledge. Finally, another 
important application is probabilistic belief revision. 

A companion paper | p4| ] presents similar probabilistic gen- 
eralizations of entailment in Pearl's System Z and of Leh- 
mann's lexicographic entailment. These formalisms, how- 
ever, are quite different from the ones in this paper In de- 
tail, the new formalisms in [ p| add an inheritance of prob- 
abilistic knowledge and a strategy for resolving inconsis- 
tencies to entailment in model-theoretic probabilistic logic. 
For this reason, they are generally much stronger than en- 
tailment in model-theoretic probabilistic logic. Thus, they 
are especially useful where the classical notion of model- 
theoretic entailment is too weak, for example, in proba- 
bilistic logic programming Other applications are 
deriving degrees of belief from statistical knowledge and 
degrees of belief, handling inconsistencies in probabilistic 
knowledge bases, and probabilistic belief revision. 

The main contributions of this paper are as follows: 

• We show that the notions of g-coherence and of g- 
coherent entailment in probabilistic logic under coherence 
can be expressed in terms of probability rankings. 

• We present new probabilistic generahzations of entail- 
ment in Pearl's System Z and Lehmann's lexicographic en- 
tailment, which lie between model-theoretic probabilistic 
entailment and probabilistic entailment under coherence. 

• We analyze and compare some general nonmonotonic 
properties of the new notions of entailment, of model- 
theoretic probabilistic entailment, and of probabilistic en- 
tailment under coherence. In particular, it turns out that the 
new formalisms satisfy the properties of Rational Mono- 
tonicity and Irrelevance, while probabilistic entailment un- 
der coherence is lacking these properties. 

• We analyze the relationship between the new notion of 
entailment in System Z, the new notion of lexicographic 
entailment, model-theoretic probabiUstic entailment, and 
probabilistic entailment under coherence. 

• We show that the new notions of entailment in Sys- 
tem Z and of lexicographic entailment are proper gener- 
alizations of their classical counterparts. 

The rest of this paper is organized as follows. Section || 
gives some technical preliminaries. In Section ||, we show 
that probabilistic reasoning under coherence can be ex- 
pressed in terms of probability rankings, and we introduce 
the new probabilistic notions of entailment in System Z 
and of lexicographic entailment. Section ^ concentrates on 
the properties of the new formalisms and of the standard 
ones. In Section pi we summarize the main results and give 



an outlook on future research. Note that detailed proofs of 
all results are given in the extended paper [^. 

2 Preliminaries 

In this section, we first define probabilistic knowledge 
bases. We then recall the notions of satisfiability and of 
logical entailment from model-theoretic probabilistic logic, 
and the notions of g-coherence and of g-coherent entail- 
ment from probabilistic logic under coherence. 

2.1 Probabilistic Knowledge Bases 

We assume a set of basic events $ = {pi, . . . ,pn} with 
n > 1. We use _L and T to denote false and true, respec- 
tively. We define events by induction as follows. Every 
element of $ U {_L, T} is an event. If and are events, 
then also -i0 and {(pAip). A logical constraint is an event of 
the form ?/> 4= 0. A conditional event is an expression of the 
form iIj\4> with events t/j and (f). A conditional constraint is 
an expression of the form (?/;| </))[!, u] with events tp, (p, and 
real numbers w e [0, 1]. We define probabilistic formu- 
las by induction as follows. Every conditional constraint is 
a probabilistic formula. If F and G are probabilistic for- 
mulas, then also -iF and {F A G). We use (FVG) and 
(F^G) to abbreviate -.(-.FA-^G) and -.(-.FAG), re- 
spectively, where F and G are either two events or two 
probabilistic formulas. We adopt the usual conventions 
to eliminate parentheses. 

A world / is a truth assignment to the basic events 
in $ (that is, a mapping /: $ — > {true, false}), which 
is inductively extended to all events by /(±)= false, 
/(T) =true, /(-.0) =true iff 1(0) = false, and A 
'0))=true iff I {(/)) = I (ip) —true. We use 2$ to de- 
note the set of all worlds for $. A world / satisfies 
an event cf), or / is a model of cf), denoted I ^cf), iff 
/((/)) = true. We extend worlds / to conditional events 
ip\(l) by /(-(Alf/)) =true iff I^ipAcf), /(tAI^) = false 
iff / ^ A (p, and I{ip\4i) = indeterminate iff / |= -.0. 
A probabilistic interpretation Fr is a probability func- 
tion on 2$ (that is, a mapping Pr:I^ [0, 1] such that 
all Pr{I) with /g2$ sum up to 1). The probability of 
an event (p in the probabilistic interpretation Pr, denoted 
Pr{cp), is the sum of all Pr{I) such that / G X$ and I^(p. 
For events (p and ip with Pr{(p) > 0, we write Pr{ip\ip) to 
abbreviate Pr{ip A (p) / Pr{(p). The truth of logical con- 
straints and probabilistic formulas F in a probabilistic in- 
terpretation Pr, denoted Pr [= F, is defined as follows: 

• Pr^i'^(p iff Pr{ipA(p) = Pr{(p). 

• Pr ^ {ip\(p)[l,u] iff Pr{(p)^Ooi Pr{ip\(p) (E[1,u]. 

• Pr^^F iff not Pr ^ F. 



• Pr'^{F AG) iff Pr'^F and Pr [= G. 

We say Pr satisfies F, or Pr is a model of F, iff Pr \= F. 
We say Pr satisfies a set of logical and conditional con- 
straints !F, or Pr is a model of IF, denoted Pr [= T, iff Pr 
is a model of all F ^T. 

A probabilistic knowledge base KB = {L,P) consists 
of a finite set of logical constraints L and a finite set 
of conditional constraints P such that (i) I <u for all 
{ip\(p)[l,u] G P, and (ii) ipilcpi ^ V'2|02 for any two dis- 
tinct {ipi\(pi)[li,ui], {ip2\<p2)[l2,U2] G F. Note that here 
ipi\(pi 7^ ip2\(p2 iff either ipi A (pi is not logically equiva- 
lent to V'2 A 02, or (pi is not logically equivalent to (p2- 

Example 2.1 A sample probabilistic knowledge base 
KB = (L, P) is given as follows; 

L = {bird 4= penguin} , 

F = {(haveJegs|bird)[l,l],(fly| bird)[l,l]}. 

Here, L represents the logical knowledge "all penguins are 
birds". Moreover, in model-theoretic probabilistic logic, 
F expresses the logical knowledge "all birds have legs" 
and "all birds fly", while in probabilistic logic under co- 
herence and in the new nonmonotonic logics, F expresses 
the default logical knowledge "typically, birds have legs" 
and "typically, birds fly". 

Another probabilistic knowledge base KB' = {L' , P') is 
given as follows: 

L' = {bird penguin} , 
F' = {(haveJegs|bird)[l,l],(fly|bird)[l,l], 
(fly|penguin)[0,0.05]}. 

In model-theoretic probabilistic logic, the additional con- 
ditional constraint (fly | penguin) [0, 0.05] represents the 
probabilistic knowledge "at most 5% of all penguins fly", 
while in probabilistic logic under coherence and in the new 
nonmonotonic logics, (fly | penguin) [0, 0.05] represents the 
default probabilistic knowledge "typically, penguins fly 
with a probability of at most 0.05". □ 

2.2 Model-Theoretic Probabilistic Logic 

We now recall the model-theoretic notions of satisfiability 
and of logical entailment. 

A set of logical and conditional constraints is satisfiable 
iff a model of JF exists. A probabilistic knowledge base 
KB = {L,P) is satisfiable iff F U F is satisfiable. 

A conditional constraint G is a logical consequence of a set 
of logical and conditional constraints T, denoted T\\=C, 
iff every model of F is also a model of G. A conditional 



constraint ('0|(^)[Z, u] is a tight logical consequence of J^, 
denoted ^\\=tight{'4'\4')[l ^ iff ^ (resp., u) is the infimum 
(resp., supremum) of Pr{tlj\(j)) subject to all models Pr 
of T with Pr{4)) > 0. Note that we define I = 1 and u = 0, 
whenjr||= (0|T)[O,O]. A conditional constraint C is a /og- 
ical consequence of a probabilistic knowledge base KB, 
denoted KB |^ C, iff L U P ||= C. It is a tight logical con- 
sequence of KB, denoted KB\\=jjgi^jC, iff L U P\\=^ti<^ht^- 

Example 2.2 The probabilistic knowledge base KB of Ex- 



ample 2.1 has the following logical consequences: 



(fly I bird) [1,1], (haveJegs | bird)[l, 1], 

(fly I penguin)[l, 1], (have_legs | penguin)[l, 1] . 

In fact, all these conditional constraints are even tight logi- 
cal consequences of KB. 

The probabilistic knowledge base KB' — (L', P') of Ex- 
ample 2. 1 has the following tight logical consequences: 



(fly I bird)[l,l], (haveJegs | bird)[l, 1], 

(fly I penguin) [1, 0], (haveJegs | penguin) [1, 0] . 

Here, the empty interval "[1, 0]" in the last two conditional 
constraints is due to the fact that the logical property of be- 
ing able to fly is inherited from birds to penguins and is 
incompatible there with the knowledge that at most 5% of 
all penguins are able to fly. Hence, in this example, the no- 
tion of logical entailment is too strong, as the desirable tight 
conclusions from KB' are given by (fly | penguin) [0, 0.05] 
and (have_legs | penguin) [1, 1], respectively. □ 

2.3 Probabilistic Logic under Coherence 

We now recall the notions of g-coherence and of g-coherent 
entailment. We define them by using some recent charac- 
terizations through concepts from default reasoning [p^]. 
We first give some preparative definitions. 

A probabilistic interpretation Pr verifies a conditional con- 
straint u] iff Pr{(j)) > and Pr \= {ij;\(l))[l,u]. It 
falsifies a conditional constraint (■0|0)[Z,w] iff Pr{(j>) > 
and Pr ^ {ilj\(f))[l,u]. A set of conditional constraints P 
tolerates a conditional constraint C under a set of logical 
constraints L iff L U P has a model that verifies C. A set 
of conditional constraints P is under L in confiict with C 
iff no model of LU P verifies C. 

A conditional constraint ranking cr on a probabilistic 
knowledge base KB = {L,P) maps each element of P to 
a nonnegative integer. It is admissible with KB iff every 
P' C P that is under L in conflict with some C G P con- 
tains a conditional constraint C such that cr(C") <(j{C). 

We are now ready to define the concept of g-coherence. 
A probabiUstic knowledge base KB is g-coherent iff there 



exists a conditional constraint ranking on KB that is admis- 
sible with KB. 

We next define the notion of g-coherent entailment. 
Let KB ~{L,P) be a g-coherent probabilistic knowl- 
edge base, and let {ip\(f>)[l,u] be a conditional constraint. 
Then, {'ip\(f>)[l, u] is a g-coherent consequence of KB, de- 
noted KB\\^^{^\(l))[l,u], iff (i,PU {(?M(/))[p,p]}) is not 
g-coherent for all p G [0, 1) U (u, 1]. We say {ip\(p)[l, u] is a 
tight g-coherent consequence of KB, denoted KB \\^^,^gi^f. 
{ip\(l))[l,u], iff / (resp., u) is the infimum (resp., supre- 
mum) of p subject to all g-coherent probabilistic knowl- 
edge bases {L, PU {{'t/j\(f))[p,p]}). 

Example 2.3 The probabilistic knowledge base KB of Ex- 
ample ^j]has the following tight g-coherent consequences: 

(fly I bird) [1,1], (haveJegs | bird) [1, 1], 

(fly I penguin) [0, 1], (haveJegs | penguin) [0, 1] . 

Here, the interval "[0, 1]" in the last two conditional con- 
straints is due to the fact that the logical properties of be- 
ing able to fly and of having legs are not inherited from 
birds to penguins. Thus, in this example, the notion of 
g-coherent entailment is too weak, as the desirable tight 
conclusions from KB are given by (fly | penguin) [1, 1] and 
(have_legs | penguin) [1, 1], respectively. 



The probabilistic knowledge base KB' of Example 2. 1 has 
the following tight g-coherent consequences: 

(fly I bird)[l, 1], (haveJegs | bird)[l, 1], 

(fly I penguin)[0, 0.05], (have.legs | penguin)[0, 1] . 

Here, the last interval "[0, 1]" is due to the fact that the 
logical property of having legs is not inherited from birds 
to penguins. Thus, also in this example, g-coherent en- 
tailment is too weak, as the desirable tight conclusion 
from KB' is given by (have_legs | penguin)[l, 1]. □ 

3 Nonmonotonic Probabilistic Logics 

In this section, we first show that the notions of g-coherence 
and of g-coherent entailment can be expressed in terms of 
probability rankings. We then introduce new probabilis- 
tic generalizations of Pearl's entailment in System Z and 
of Lehmann's lexicographic entailment. Observe that the 
notion of g-coherent entailment is defined through a set of 
probability rankings, while the new notions of entailment 
in System Z and of lexicographic entailment are each de- 
fined through a unique single probability ranking. 

In some sense, the new formalisms are second-order for- 
malisms, as probability rankings are closely related to pos- 
sibility measures over probabilities and can thus be seen as 
uncertainty measures over other uncertainty measures. 



3.1 Probability Rankings 

We now show that g-coherence and g-coherent entailment 
can be defined in terms of admissible probability rankings. 
We first give some preparative definitions. 

In the sequel, we use a > to abbreviate the probabilis- 
tic formula -i(a|T)[0, 0]. A probability ranking k maps 
each probabilistic interpretation on 2$ to a member of 
{0, 1, . . . } U {oo} such that K{Pr) = for at least one in- 
terpretation Pr. It is extended to all logical constraints and 
probabilistic formulas F as follows. If F is satisfiable, then 
k{F) = mill {K{Pr) \ Pr |= F}; otherwise, k{F) = cxo. A 
probability ranking k is admissible with a probabilis- 
tic knowledge base KB~{L,P) iff k{-^F) = oo for 
all F G £ and K{(f> >0)<oo and k(0 > A (V'|(/>)[^ m]) < 
K{(f)>OA^{il;\(l))[l,u]) for all {ip\<p)[l,u] e P. 

The following result shows that g-coherence is equivalent 
to the existence of an admissible probability ranking. 

Theorem 3.1 Let KB = (L, P) be a probabilistic knowl- 
edge base. Then, KB is g-coherent iff there exists a proba- 
bility ranking k that is admissible with KB. 

The next theorem shows that g-coherent entailment can be 
expressed in terms of admissible probability rankings. 

Theorem 3.2 Let KB = {L, P) be a g-coherent proba- 
bilistic knowledge base, and let {'>p\4>) [I, u] be a conditional 
constraint. Then, KB \\^^ (ip\(l))[l,u] iff K{(j)> 0) = oo or 
k((/)>0 a {ip\(j))[l,u]) < K((/)>OA^(V'|0)[/,u])/or every 
probability ranking k that is admissible with KB. 

3.2 System Z 

We now extend Pearl's entailment in System Z |3^ 
to g-coherent probabilistic knowledge bases KB ^{L,P). 
The new notion of entailment in System Z is linked to an 
ordered partition of P, a conditional constraint ranking z 
on KB, and a probability ranking k^. 

The z-partition of KB is the unique ordered partition 
(Po, . . . , Pfc) of P such that each P,, i e {0, . . . , fc}, is the 
set of all C G P - (Pq U • • ■ UPi_i ) that is tolerated under L 
byP-(PoU---UP,_i). 

Example 3.3 The z-partition of the probabilistic knowl- 
edge base KB ~ {L,P) in Example 2. 1 is given by: 



(Po) = ({(haveJegs|bird)[l,l],(fly|bird)[l,l]}). 

The z-partition of the probabilistic knowledge base 
KB' = (P', P') in Example [2.1 1 is given as follows: 

(Po',Pi') - ({(haveJegs|bird)[l,l],(fly|bird)[l,l]}, 
{(fly|penguin)[0,0.05]}). □ 



We next define the conditional constraint ranking z and 
the probability ranking k^. For every j E {0, . . . , k}, each 
C G Pj is assigned the value j under z. The probability 
ranking on all probabilistic interpretations Pr is then 
defined as follows: 

if Pr ^ L 

K^(Pr) = {0 if Pr\= LUP 

max z(C) otherwise. 

CeP: Pr\^C 

The following lemma shows that, in fact, z is a conditional 
constraint ranking on KB that is admissible with KB, and 
is a probability ranking that is admissible with KB. 

Lemma 3.4 Let KB be a g-coherent probabilistic knowl- 
edge base. Then, 

(a) z is admissible with KB. 

(b) is admissible with KB. 

We next define a preference relation on probabilistic inter- 
pretations as follows. For probabilistic interpretations Pr 
and Pr', we say Pr is z-preferable to Pr' iff K^{Pr) < 
K^{Pr'). A model Pr of a set of logical and conditional 
constraints .7^ is a z-minimal model of iff no model of T 
is z-preferable to Pr. 

We finally define the notion of z-entailment as follows. A 
conditional constraint C is a z-consequence of KB, de- 
noted KB ||~^C, iff every z-minimal model of L satis- 
fies C. A conditional constraint {ip\(l))[l,u] is a tight z- 
consequence of KB, denoted KB (-0| it], iff 

I (resp., u) is the infimum (resp., supremum) of Pr{il>\(f)) 
subject to all z-minimal models Pr of L with Pr{(j>) > 0. 

The following example shows that z-entailment realizes 
an inheritance of logical properties from classes to non- 
exceptional subclasses. However, logical properties are not 
inherited from classes to subclasses that are exceptional 
with respect to some other property (in classical default 
reasoning from conditional knowledge bases, we call this 
undesirable feature inheritance blocking). 

Example 3.5 The probabilistic knowledge base KB of Ex- 
ample ^^l] has the following tight z-consequences: 

(fly|bird)[l, 1], (haveJegs|bird)[l, 1], 
(fly|penguin)[l, 1], (haveJegs|penguin)[l, 1] . 



The probabilistic knowledge base KB' of Example 2. 1 has 
the following tight z-consequences: 

(fly|bird)[l, 1], (haveJegs|bird)[l, 1], 
(fly|penguin)[0, 0.05], (have_legs| penguin) [0, 1] . 



Here, the last interval "[0, 1]" is due to the fact that the log- 
ical property of having legs is not inherited from birds to 
its exceptional subclass penguins. □ 

The following lemma describes an alternative way of defin- 
ing the notion of z-consequence. 

Lemma 3.6 Let KB be a g-coherent probabilistic knowl- 
edge base, and let C ~ {'ip\(j))[l, u] be a conditional con- 
straint. Then, KB \\^ ijfu^'ict) > 0) = cxj or > A 
C) <K^(^>OA-C). 

3.3 Lexicographic Entailment 

We next extend Lehmann's lexicographic entailment | ]37| ] 
to g-coherent probabilistic knowledge bases KB ~{L,P). 
Note that even though we do not use probability rankings 
here, the new notion of entailment can be easily expressed 
by a unique single probability ranking. 

We use the z-partition {Pq, . . . ,Pk) of KB to define a 
lexicographic preference relation on probabilistic inter- 
pretations as follows. For probabilistic interpretations 
Pr and Pr, we say Pr is lexicographically preferable 
(or lex-preferable) to Pr iff some i £ {0, . . . , fc} exists 
such that \{CeP^\Pr^C}\>\{CePi\Pr'^C}\ and 
\{CePj \Pr^C}\ = \{CePj I Pr' 1= C}\ for all i<j<k. 
A model Pr of a set of logical and conditional constraints 
is a lexicographically minimal model (or lex-minimal 
model) of iff no model of T is Zex-preferable to Pr. 

A conditional constraint C is a lex-consequence of KB, 
denoted KB Ih^'^^'^C, iff every /ex-minimal model of L 
satisfies C. A conditional constraint {ip\(f>)[l,u] is a tight 
lex-consequence of KB, denoted KB {tp\(f>)[l,u], 
iff I (resp., u) is the infimum (resp., supremum) of Pr{ijj\(f)) 
subject to all /ex-minimal models Pr of L with Pr{(t)) > 0. 

The following example shows that /ez-entailment realizes 
a correct inheritance of logical properties. In particular, 
it does not show the problem of inheritance blocking. 

Exam ple 3.7 The probabilistic knowledge base KB of Ex- 
ample^]!] has the following tight Ze.T-consequences: 

(fly I bird)[l,l], (haveJegs | bird)[l, 1], 

(fly I penguin)[l, 1], (have_legs | penguin)[l, 1] . 



The probabilistic knowledge base KB' of Example 2.1 has 
the following tight Zex-consequences: 

(fly I bird)[l, 1], (haveJegs | bird)[l, 1], 

(fly I penguin)[0, 0.05], (have.legs | penguin)[l, 1] . □ 



4 Properties 

In this section, we analyze some properties of logical en- 
tailment, g-coherent entailment, z-entailment, and lex- 
entailment. We first describe some general nonmonotonic 
properties. We then explore the relationship between the 
formalisms, and the one to their classical counterparts. 

4.1 General Nonmonotonic Properties 

We now analyze some general nonmonotonic properties of 
the probabilistic formalisms of this paper It is important to 
point out that these properties are especially related to the 
inheritance of logical knowledge. 

We first consider the postulates Right Weakening (RW), Re- 
fiexivity (Ref), Left Logical Equivalence (LLE), Cut, Cau- 
tious Monotonicity (CM), and Or by Kraus et al. [Q, 
which are commonly regarded as being particularly de- 
sirable for any reasonable notion of nonmonotonic entail- 
ment. The following result shows that logical entailment, 
g-coherent entailment, z-entailment, and ^ex-entailment all 
satisfy (probabilistic versions of) these postulates. 

Theorem 4.1 ||~^, \\^^,and \\^'^^^ satisfy the follow- 
ing properties for all probabilistic knowledge bases KB ~ 
(L, P), all events e, e' , 4>, and tp, and all 1,1' ,u,u' £ [0, 1]." 

RW. If{(t)\T)[l, u] ^ {ip\T)[l', u'] is logically valid 
and KB \\^ {(f>\e)[l,u], then KB (V'|£)[Z', u']. 

Ref KB\[^{e\e)[l,l]. 

LLE. If e <^e' is logically valid, 

then KB {(l)\e)[l , u] iff KB \\^ {(f>\e')[l,u]. 

Cut. If KB |^-(£|e')[l,l] and KB \\^ {<j)\e /\ e' )[l , u], 
then KB \\^ {(t)\e')[l,u\. 

CM. If KB \\^ (e|e')[l, 1] and KB \\^ i(j)\e')[l, u], 
then KB \\^ {(t)\e Ae')[l,u]. 

Ok If KB \\^{(j)\e)[l,l] and KB \\^ {(j)\e')[l,l], 
thenKB\\^{(t)\e\'e')[l,l]. 

Another desirable property is Rational Monotonicity (RM) 
[|^, which describes a restricted form of monotony, and 
allows to ignore certain kinds of irrelevant knowledge. The 
next theorem shows that logical entailment, z-entailment, 
and Ze.T-entailment satisfy RM. Here, we use KB\\/^C to 
denote that it is not the case that KB \[^ C. 

Theorem 4.2 \\=, ||~'', and \\^'''^'^ satisfy the follow- 
ing property for all probabilistic knowledge bases KB = 
(L, P), all events e, e', and ip, and all l,u£ [0, !].• 



Figure 1 : Logical Implications between Consequence Relations 



RM. If KB \[^ {i:\e)[l,l] and KB (^e'|£)[l, 1], 
then KB \\^ {tP\e As')[l,l]. 

The following example shows that g-coherent entailment, 
however, generally does not satisfy RM. 



of KB, but (fly I red A bird)[l, 1] is not a g-coherent con- 
sequence of KB. We remark that (fly | red A bird)[l, 1] is 
the tight logical consequence (resp., z-consequence, Zex- 
consequence) of KB, while (fly | red A bird) [0, 1] is the 
tight g-coherent consequence of KB. □ 



Example 4.3 Consider the probabilistic knowledge base 

KB = {L,P) = ({bird beagle}, {(fly I bird)[l,l]}) . 

Then, (fly | bird)[l, 1] is a logical consequence (resp., g- 
coherent consequence, z-consequence, Z ex-consequence) 
of KB. Moreover, (-leagle | bird)[l, 1] is not a logical con- 
sequence (resp., g-coherent consequence, z-consequence, 
Zecc-consequence) of KB. 

Observe now that (fly | bird A eagle) [1, 1] is a logical con- 
sequence (resp., z-consequence, Z ex-consequence) of KB, 
but (fly I bird A eagle) [1, 1] is not a g-coherent consequence 
of KB. We remark that (fly | bird A eagle) [1, 1] is the tight 
logical consequence (resp., z-consequence, /ex-conse- 
quence) of KB, while (fly | bird A eagle) [0, 1] is the tight 
g-coherent consequence of KB. □ 

We now consider the property Irrelevance (Irr) adapted 
from [^. Informally, Irr says that e' is irrelevant to a con- 
clusion "P ||~ (^/;|e)[l, 1]" when they are defined over dis- 
joint sets of atoms. The following result shows that logical 
entailment, z-entailment, and /ea--entailment satisfy Irr. 

Theorem 4.4 m ||~^, and \\-^'''^^ satisfy the follow- 
ing property for all probabilistic knowledge bases KB = 
{L, P) and all events e, e' , and ip: 

Irr If KB \\^ ('ip\e)[l, 1], and no atom of KB and 

{ip\e)[l, 1] occurs in e', then KB \\^ {ip\eAe')[l, 1]. 

The following example shows that g-coherent entailment, 
however, does not satisfy Irr. 

Example 4.5 Consider the probabilistic knowledge base 

KB = {L,P) = (0,{(fly|bird)[l,l]}). 

Clearly, (fly | bird)[l, 1] is a logical consequence (resp., g- 
coherent consequence, z-consequence, Z ex-consequence) 
of KB. Observe now that (fly | red A bird)[l, 1] is a logi- 
cal consequence (resp., z-consequence, lex-consequence) 



We finally consider the property Direct Inference (DI) 
adapted from [^. Informally, DI expresses that P should 
entail all its own conditional constraints. The following 
theorem shows that logical entailment, g-coherent entail- 
ment, z-entailment, and Zex-entailment all satisfy DI. 

Theorem 4.6 m ||^^, ||~^, and \]^'''^^ satisfy the fol- 
lowing property for all probabilistic knowledge bases 
KB = (P, P), all events e, (j), and ip, and all 1,uG[0, 1]: 



DI If{ij\(j))[l,u]ePande<=:>i 
then KB ||- (■0|£)[^ it]. 



is logically valid, 



4.2 Relationship between Probabilistic FormaUsms 

We now explore the logical implications between the prob- 
abilistic formalisms of this paper. 

The following theorem shows that the logical implications 
illustrated in Fig. |l] hold between logical entailment, g- 
coherent entailment, z-entailment, and /ex-entailment. 

Theorem 4.7 Let KB = (L, P) be a g-coherent proba- 
bilistic knowledge base, and let C = , u] be a con- 
ditional constraint. Then, 

(a) KB\[^^C implies KBW^^'C. 

(b) KB\\^^C implies KB ^"""C. 

(c) KB\^ '""'C implies KB\\^C. 

In gene ral, none of the converse implications holds, as Ex- 
amples 2.2, 2.3, 3.5, and 3.7 immediately show. But in the 
special case when LlJP has a model in which the con- 
ditioning event (f) has a positive probability, the notions 
of logical entailment, z-entailment, and /ex-entailment 
of {ip\4i)[l,u] from KB all coincide. This important result 
is expressed by the following theorem. 

Theorem 4.8 Let KB ~ (L, P) be a g-coherent proba- 
bilistic knowledge base, and let C = {ip\4>)[l,u] be a 



1^'-^ 



^ ^ ^ ^ \^ 

Figure 2: Relationship to Classical Formalisms 



conditional constraint such that LU P has a model Pr 
with Pr((f>) > 0. Then, 

KB |h= C iff KB h ''"C ff KB ^ 'C. 

The following example shows that g-coherent entailment, 
however, generally does not coincide with logical entail- 
ment when LU P has a model Pr with Pr{4>) > 0. 

Example 4.9 Consider again the probabilistic knowledge 
base KB = {L,P) = ({bird ^ eagle}, {(fly | bird)[l, 1]}). 
Then, LU P has clearly a model Pr with Fr(eagle) > 0. 

It is now easy to verify that (fly | eagle) [1, 1] is a logical 
consequence (resp., z-consequence, /ea--consequence) of 
KB, but (fly I eagle) [1, 1] is not a g-coherent consequence 
of KB. We remark that (fly | eagle) [1, 1] is the tight logi- 
cal consequence (resp., z-consequence, Z ex-consequence) 
of KB, while (fly | eagle) [0, 1] is the tight g-coherent con- 
sequence of KB. □ 

4.3 Relationship to Classical Formalisms 

We now analyze the relationship between the probabiUstic 
formalisms of this paper and their classical counterparts. 
We first give some technical preparation as follows. 

The operator 7 on conditional constraints, sets of con- 
ditional constraints, and conditional knowledge bases re- 
places each conditional constraint (V'l'/') [1, 1] by the classi- 
cal default ^ 0. We use the expressions \^^, ^ '^^ , 
and 1= to denote the classical notions of entailment in Sys- 
tem P, Pearl's entailment in System Z, Lehmann's lexico- 
graphic entailment, and logical entailment, respectively. 

The following well-known result says that logical entail- 
ment in model-theoretic probabilistic logic is a generaliza- 
tion of logical entailment in classical propositional logic. 

Theorem 4.10 Let KB ~ {L, P) be a g-coherent prob- 
abilistic knowledge base, where P ~ {{tpi\(j)i)[l,l], . . ., 
('0n|0n)[l, 1]}), (^nd let (P\a)[l, 1] be a conditional con- 
straint. Then, 

KB\[^iP\a)[l,l] iff^{KB)^l3^a. 



The next theorem recalls the recent result by Biazzo et 
al. [ p^ l that g-coherent entailment is a generalization of de- 
fault entailment in System P. 

Theorem 4.11 (Biazzo et al. [0|) Let KB = (L, P) be a 

g-coherent probabilistic knowledge base, where P = 
{(V^i|(^i)[l, 1], . . . , (Va.|</'„)[1, 1]}), and let (/3|a)[l, 1] be 
a conditional constraint. Then, 

iCB|h'(/3|a)[l,l] ff j{KB)^ '''P<-a. 

The following theorem shows that the new notions of 
z- and Zex-entailment for g-coherent probabilistic knowl- 
edge bases generalize their classical counterparts for e- 
consistent conditional knowledge bases. 

Theorem 4.12 Let KB = {L,P) be a g-coherent prob- 
abilistic knowledge base, where P ~ {{ipi\(j)i)[l, 1], . . ., 
i'>Pn\4'n)[^, 1]}), ond let {P\a)[l, 1] be a conditional con- 
straint. Then, 

(a) KB\^\f3\a)[l,l] ff j{KB) f3 ^ a. 

(b) KB\^''^{P\a)[l,l] ffjiKB)^''^P^a. 

5 Summary and Outlook 

We have presented probabilistic generaUzations of Pearl's 
entailment in System Z and of Lehmann's lexicographic 
entailment that lie between entailment in model-theoretic 
probabilistic logic and entailment in probabilistic logic un- 
der coherence. That is, the new formalisms properly gener- 
alize their counterparts in classical default reasoning, they 
are weaker than model-theoretic probabilistic entailment, 
and they are stronger than probabilistic entailment under 
coherence. The new formalisms are useful especially for 
handling probabilistic inconsistencies related to condition- 
ing on zero events. Furthermore, they can be applied for 
probabilistic belief revision. More generally, in the same 
spirit as a similar previous paper, this paper sheds light on 
exciting new formalisms for probabilistic reasoning beyond 
the well-known standard ones. 



An interesting topic of future research is to develop algo- 
rithms for the new formalisms and to analyze their compu- 
tational complexity (along the lines of 

Another very interesting topic of future research is to de- 
velop and explore further nonmonotonic formalisms for 
reasoning with conditional constraints. Besides extend- 
ing classical formalisms for default reasoning from con- 
ditional knowledge bases, which may additionally con- 
tain a strength assignment to the defaults, one may also 
think about combining the new formalisms of this pa- 
per and of with some probability selection technique 
(as e.g. maximum entropy or center of mass). 
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